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- The MAILING DATE of this communication appears on the cover sheet with the correspondence address - 
Period for Reply 



A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) OR THIRTY (30) DAYS, 
WHICHEVER IS LONGER, FROM THE MAILING DATE OF THIS COMMUNICATION. 

• Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1 .704(b). 

Status 

1)E3 Responsive to communication(s) filed on 17 November 2005 . 
2a)D This action is FINAL 2b)E3 This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 1 1 , 453 O.G. 213. 

Disposition of Claims 

4) ^ Claim(s) 1-4.6-13.15 and 17-22 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) |H Claim(s) 1-4.6-13. 15. 17. 19.20 and 22 is/are rejected. 

7) S Claim(s) 18 and 21 is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10) 13 The drawing(s) filed on 1 1 April 2005 is/are: a)S accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 
Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 

11) D The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 

Priority under 35 U.S.C. § 119 
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application from the International Bureau (PCT Rule 17.2(a)). 
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DETAILED ACTION 
Continued Examination Under 37 CFR 1.114 

A request for continued examination under 37 CFR 1 . 1 1 4, including the fee set 
forth in 37 CFR 1 .1 7(e), was filed in this application after final rejection. Since this 
application is eligible for continued examination under 37 CFR 1.114, and the fee set 
forth in 37 CFR 1.17(e) has been timely paid, the finality of the previous Office action 
has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on 
November 17, 2005 has been entered. 

Response to Arguments 

Applicant's arguments with respect to claims 1-4, 11-12 and 19-20 have been 
considered but are moot in view of the new ground(s) of rejection. 

Applicant's amendment necessitated the new ground(s) of rejection presented in 
this Office action. 

Specification 

The disclosure is objected to because of the following informalities: 
The disclosure is objected to because it contains the limitation of "see May et al. 
USSN 09/224,547 filed December 31, 1998" on page 1, lines 18-19. This should be 
changed to read, "see May et al. US Patent No. 6,714,249 issued March 30, 2004." 

The disclosure is objected to because it contains the limitation of "Gallagher et al. 
USSN 09/293,197 filed April 19, 1999" on page 2, line 11. This should be changed to 
read, "Gallagher et al. US Patent No. 6,670,988 issued December 30, 2003." 
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The disclosure is objected to because it contains the limitation of "Gallagher et al. 
USSN 09/626,882 filed July 27, 2000" on page 2, line 20. This should be changed to 
read, "Gallagher et al. US Patent No. 6,941,027 issued September 6, 2005." 

The disclosure is objected to because it contains the limitation of "Copending 

USSN (EK Docket 83516/THC) filed by Cahill et al. November 5, 2001" on page 

10, lines 1-2. This should be changed to read "Copending USSN 10/008,026 filed by 
Cahill et al. November 5, 2001." 

The disclosure is objected to because it contains an embedded hyperlink and/or 
other form of browser-executable code (page 7, line 1 ). Applicant is required to delete 
the embedded hyperlink and/or other form of browser-executable code. See MPEP § 
608.01. 

Appropriate correction is required. 

Claim Rejections • 35 USC § 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

1. Claims 1-3, 6, 7, 13, 15, 17, 19-20, and 22 are rejected under 35 U.S.C. 103(a) 

as being unpatentable over Hashimoto (US Patent # 6,249,616) in view of Hashimoto et 

al. (US Patent # 6,249,317) and further in view of Toyoda et al. (US Patent # 

5,461,440). 
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2. In regard to claim 1 , note Hashimoto '616 discloses the use of a method for 
producing a composite digital image, comprising the steps of providing a plurality of 
partially overlapping source digital images having pixel values that are linearly or 
logarithmically related to scene intensity, wherein the source images have overlap 
regions wherein pixels of the images correspond in scene content and differing in scene 
content outside said overlap regions (column 4, lines 6-21 and figure 3-4), computing a 
radial exposure transform to compensate for exposure fall off as a function of the 
distance of a pixel from the center of the digital image (column 6, lines 52-60; the 
images are compensated for vignetting using a computed transform), modifying the 
source digital images by applying a radial exposure transform to one or more of the 
source digital images to produce adjusted source digital images (column 6, lines 52-60; 
the images are compensated for vignetting using a computed transform), and combining 
the adjusted source digital images to form a composite digital image by blending said 
overlap regions (column 6, lines 26-35; the two images are normalized in order to blend 
them). 

Therefore, it can be seen that Hashimoto '616 fails to disclose that the step of 
determining the focal length of the source digital images based upon one or more sets 
of corresponding pixel values of the source digital images and using the determined 
focal length to calculate the radial transform. 

In analogous art, Hashimoto '317 discloses the use of an automatic exposure 
control apparatus. Hashimoto '317 discloses the use of an image signal to determine 
focal length of an image (column 10, lines 30-49; the auto-focus routine determines the 
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focal length based on the image signal). Therefore, it would have been obvious to one 
of ordinary skill in the art to modify the primary reference to include the calculation of the 
focal length of an image based on the image signal as suggested by Hashimoto '317, in 
order to reduce the sized of the video camera by eliminating the need for extra sensors 
(column 10, lines 15-20). 

Also in analogous art, Toyoda discloses the use of an image correction system. 
Toyoda discloses the use of the focal length to determine the radial transform for the 
correction of exposure falloff (column 1 , lines 49-52, the marginal attenuation is 
considered exposure falloff; column 10, line 17-column 11, line 55; the focal length is 
used to compensate for marginal attenuation in the image). Therefore, it would have 
been obvious to one of ordinary skill in the art to modify the primary device to use focal 
length to determine the radial transform for correction of exposure falloff, as suggested 
by Toyoda, in order to edit the image without the use of heavy / large lens systems 
(column 1, lines 62-62). 

3. In regard to claim 2, note Hashimoto '616 discloses the use of a step of applying 
a linear exposure transform to one or more of the source digital images prior to 
combining the adjusted source digital images to produce adjusted source digital images 
having pixel values that closely match in an overlapping region (column 6, lines 26-35; 
the images are normalized in order to match the two and composite them together). 

4. In regard to claim 3, note Toyoda discloses that the radial exposure transform 
includes a cos 4 dependence on the distance from the center of the image (column 1 , 
lines 46-52; the vignetting is influenced by the cos 4 law of illumination) 
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5. In regard to claim 6, note Hashimoto '616 discloses that the combining step 
includes calculating an average of the pixel values in the overlapping region (column 6, 
lines 26-35; the two images are averaged in order to blend them). 

6. In regard to claim 7, note Hashimoto '616 discloses transforming the pixel values 
of the composite digital image to output device compatible color space (column 1 3, lines 
15-27). 

7. In regard to claim 1 3, note Toyoda discloses the storage of the transform 
information (column 9, lines 45-48). Therefore, it can be seen that the primary 
reference of Hashimoto '616 in view of Hashimoto '317, Toyoda, and "Reference 
Input/Output Medium Metric RGB Color Encodings" fails to disclose the use of metadata 
stored with the image to store the radial transform. Official notice is taken that the 
concepts and advantages of storing additional image parameters and camera settings 
as metadata are notoriously well known and expected in the art. Therefore, it would 
have been obvious to one of ordinary skill in the art to modify the primary device to 
include the use of metadata to store the radial transform in order to store the associated 
data together for better organization as well as to keep related data together in 
instances such as data transfer from one device to another. 

8. In regard to claim 15, note the primary reference of Hashimoto '616 in view of 
Hashimoto '317, Toyoda, and "Reference Input/Output Medium Metric RGB Color 
Encodings" discloses the use of a method for producing a composite digital image as 
claimed in claim 1 . Therefore, it can be seen that the primary reference fails to disclose 
that the radial exposure transform is calculated using a flash indicator. Official notice is 
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taken that the concepts and advantages of using a flash indicator to calculate the radial 
exposure transform are notoriously well known and expected in the art. Therefore, it 
would have been obvious to one of ordinary skill in the art to modify the primary device 
to include the use of a flash indicator to calculate the radial transform in order to 
compensate for flash falloff. 

9. In regard to claim 17, note Hashimoto '616 discloses the use of a computer 
program product comprising computer readable storage medium having a computer 
program stored thereon for performing the method of claim 1 (column 3, lines 17-26). 

10. In regard to claim 19-20, these are apparatus claims, corresponding to the 
method of claims 1-2. Therefore, claims 19-20 have been analyzed and rejected as 
previously discussed with respect claims 1-2. 

11. In regard to claim 22, note Hashimoto '616 discloses that the determining step 
further comprises analyzing the exposure falloff in at least one of said overlap regions 
(column 6, lines 52-60). 

12. Claims 4 and 8-10 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Hashimoto (US Patent # 6,249,616) in view of Hashimoto et al. (US Patent # 
6,249,317) and further in view of Toyoda et al. (US Patent # 5,461,440) and "Reference 
Input/Output Medium Metric RGB Color Encodings". 

13. In regard to claim 4, note Hashimoto '616 discloses that the step of providing 
source digital images further comprises the step of applying a transform to a source 
digital image such that the pixel values of the transformed source digital image are 
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linearly or logarithmically related to scene intensity (column 3, lines 34-47; the images 
are converted for simpler computations). Therefore, it can be seen that the primary 
reference of Hashimoto '616 in view of Hashimoto '370 and Toyoda fail to disclose that 
the transform is a metric transform that is scene independent. The "Reference 
Input/Output Medium Metric RGB Color Encodings" discloses the use of a metric 
transform that is applied to a source digital image such that the pixel values of the 
transformed source digital image are linearly or logarithmically related to scene intensity 
that is scene independent (found in the abstract, RIMM/ROMM is an metric encoding 
technique used to transform the source images; and in the first two paragraphs of the 
Introduction it can be seen that the image can be device dependent instead of scene 
dependent). Therefore, it would have been obvious to one of ordinary skill in the art to 
modify the primary device to include the use of a metric transform that is applied to a 
source digital image such that the pixel values of the transformed source digital image 
are linearly or logarithmically related to scene intensity that is scene independent in 
order to increase the dynamic range of the stored image (page 7: ERIMM RGB Color 
Encoding). 

14. In regard to claim 8, note "Reference Input/Output Medium Metric RGB Color 
Encodings" discloses that the metric transform includes a color transformation matrix 
(page 4: ROMM RGB Conversion Matrix- the transform uses a color transformation 
matrix). 

15. In regard to claim 9, note "Reference Input/Output Medium Metric RGB Color 
Encodings" discloses that the metric transform includes a lookup table (page 
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2: Selection of Color Space- paragraph 2, "simple LUT-matrix-LUT transformation can 
be used"). 

16. In regard to claim 10, note Hashimoto '616 in view of Hashimoto '317, Toyoda, 
and "Reference Input/Output Medium Metric RGB Color Encodings" discloses the use of 
a method for producing a composite digital image as claimed in claim 4. Therefore, it 
can be seen that the primary reference fails to disclose that the metric transform is 
included as metadata with the corresponding source digital image. Official notice is 
taken that the concepts and advantages of storing information pertaining to the image 
as metadata is notoriously well known and expected in the art. Therefore, it would have 
been obvious to one of ordinary skill in the art to modify the primary device to include 
the storage of the metric transform as metadata in order to store the associated data 
together for better organization as well as to keep related data together in instances 
such as data transfer from one device to another. 

17. Claim 1 1 is rejected under 35 U.S.C. 103(a) as being unpatentable over 
Hashimoto (US Patent # 6,249,616) in view of Hashimoto et al. (US Patent # 6,249,317) 
and further in view of Toyoda et al. (US Patent # 5,461,440) and Inoue et al. (US Patent 
# 5,083,209). 

1 8. In regard to claim 1 1 , note the primary reference of Hashimoto '61 6 in view of 
Hashimoto '370 and Toyoda discloses the use of a method for producing a composite 
digital image as claimed in claim 2. Therefore, it can be seen that the primary reference 
fails to disclose that the linear exposure transform is a function of the shutter speed 
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used to capture the source digital image, and that the shutter speed is included as 
meta-data with the corresponding source digital image. 

Inoue discloses the use of an exposure transform that is a function of the shutter 
speed used to capture the image (column 2, lines 9-12; and column 3, lines 7-16; the 
brightness is adjusted based on a function of shutter speed; the shutter speed is 
changed to obtain the desired brightness). Inoue teaches that the use of a transform 
that is a function of shutter speed is preferred in order to obtain the desired brightness 
values of the image (column 2, lines 9-12). Therefore, it would have been obvious to 
one of ordinary skill in the art to modify the primary device to include the use of a 
transform that is a function of shutter speed as suggested by Inoue. 

Official notice is taken that the concepts and advantages of storing additional 
image parameters and camera settings as metadata are notoriously well known and 
expected in the art. Therefore, it would have been obvious to one of ordinary skill in the 
art to modify the primary device to include the use of metadata to store the shutter 
speed in order to store the associated data together for better organization as well as to 
keep related information together for instances such as data transfer from one device to 
another. 

19. Claim 12 is rejected under 35 U.S.C. 103(a) as being unpatentable over 
Hashimoto (US Patent # 6,249,616) in view of Hashimoto et al. (US Patent # 6,249,317) 
and further in view of Toyoda et al. (US Patent # 5,461 ,440) and Hirai et al. (US Patent 
#6,603,928). 
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20. In regard to claim 12, note the primary reference of Hashimoto '616 in view of 
Hashimoto '370 and Toyoda discloses the use of a method for producing a composite 
digital image as claimed in claim 2. Therefore, it can be seen that the primary reference 
fails to disclose that the linear exposure transform is a function of the f-number used to 
capture the source digital image and that the f-number is included as meta-data with the 
corresponding source digital image. 

Hirai discloses the use of an exposure transform that is a function of the f- 
number used to capture the image (column 2, lines 10-25; and column 3, lines 16-17; 
the f-number is used to compensate the image). Hirai teaches that the use of a 
transform that is a function of the f-number is preferred in order to correct image 
coloring to a desire value (column 2, lines 10-30). Therefore, it would have been 
obvious to one of ordinary skill in the art to modify the primary device to include the use 
of a transform that is a function of the f-number as suggested by Hirai. 

Official notice is taken that the concepts and advantages of storing additional 
image parameters and camera settings as metadata are notoriously well known and 
expected in the art. Therefore, it would have been obvious to one of ordinary skill in the 
art to modify the primary device to include the use of metadata to store the shutter 
speed in order to store the associated data together for better organization as well as to 
keep related information together for instances such as data transfer from one device to 
another. 
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Allowable Subject Matter 



21 . Claims 18 and 21 objected to as being dependent upon a rejected base claim, 
but would be allowable if rewritten in independent form including all of the limitations of 
the base claim and any intervening claims. 

22. As for claims 18, the prior art does not teach or fairly suggest the use of a 
method for producing a composite digital image using the root of the function: 



to calculate the focal length of the overlapping regions. 

23. As for claims 21 , the prior art does not teach or fairly suggest the use of a system 
for producing a composite digital image using the root of the function: 



The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 

US006128108A: note the use of image blending techniques in order to perform 
image compositing. 

US006549681 B1 : note the use of image blending techniques in order to perform 
image compositing. 





to calculate the focal length of the overlapping regions. 



Conclusion 
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US 20040070778A1 : note the use of image blending techniques in order to 
perform image compositing. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Chriss S. Yoder, III whose telephone number is (571) 
272-7323. The examiner can normally be reached on M-F: 8 - 4:30. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Ngoc-Yen Vu can be reached on (571 ) 272-7320. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 

CSY 

December 1 9, 2005 




